Adversarial Imitation Learning from Incomplete Demonstrations

Imitation learning targets deriving a mapping from states to actions, a.k.a. policy, from expert demonstrations. Existing methods for imitation learning typically require any actions in the demonstrations to be fully available, which is hard to ensure in real applications. Though algorithms for learning with unobservable actions have been proposed, they focus solely on state information and overlook the fact that the action sequence could still be partially available and provide useful information for policy deriving. In this paper, we propose a novel algorithm called Action-Guided Adversarial Imitation Learning (AGAIL) that learns a policy from demonstrations with incomplete action sequences, i.e., incomplete demonstrations. The core idea of AGAIL is to separate demonstrations into state and action trajectories, and train a policy with state trajectories while using actions as auxiliary information to guide the training whenever applicable. Built upon the Generative Adversarial Imitation Learning, AGAIL has three components: a generator, a discriminator, and a guide. The generator learns a policy with rewards provided by the discriminator, which tries to distinguish state distributions between demonstrations and samples generated by the policy. The guide provides additional rewards to the generator when demonstrated actions for specific states are available. We compare AGAIL to other methods on benchmark tasks and show that AGAIL consistently delivers comparable performance to the state-of-the-art methods even when the action sequence in demonstrations is only partially available.Comment: Accepted to International Joint Conference on Artificial Intelligence (IJCAI-19

Combining Transfer of TTF-1 and Pax-8 Gene: a Potential Strategy to Promote Radioiodine Therapy of Thyroid Carcinoma

Cotransfer of TTF-1 and Pax-8 gene to tumor cells, resulting in the reexpression of iodide metabolism-associated proteins, such as sodium iodide symporter (NIS), thyroglobulin (Tg), thyroperoxidase (TPO), offers the possibility of radioiodine therapy to non-iodide-concentrating tumor because the expression of iodide metabolism-associated proteins in thyroid are mediated by the thyroid transcription factors TTF-1 and Pax-8. The human TTF-1 and Pax-8 gene were transducted into the human thyroid carcinoma (K1 and F133) cells by the recombinant adenovirus, AdTTF-1 and AdPax-8. Reexpression of NIS mRNA and protein, but not TPO and Tg mRNA and protein, was detected in AdTTF-1-infected F133 cells, following with increasing radioiodine uptake (6.1~7.4 times), scarcely iodide organification and rapid iodide efflux (t1/2≈8 min in vitro, t1/2≈4.7 h in vivo).
In contrast, all of the reexpression of NIS, TPO and Tg mRNA and proteins in F133 cells were induced by the synergetic effect of TTF-1 and Pax-8. AdTTF-1 and AdPax-8 coinfected K1 and F133 cells could effectively accumulate radioiodine (6.6-7.5 times) and obviously retarded radioiodine retention (t1/2≈25-30 min in vitro, t1/2≈12 h in vivo) (p<0.05).
Accordingly, the effect of radioiodine therapy of TTF-1 and Pax-8 cotransducted K1 and
F133 cells (21-25% survival rate in vitro) was better than that of TTF-1-transducted cells
(40% survival rate in vitro) (p<0.05). These results indicate that single TTF-1 gene transfer may have limited efficacy of radioiodine therapy because of rapid radioiodine efflux. The cotransduction of TTF-1 and Pax-8 gene, with resulting NIS-mediated radioiodine accumulation and TPO and Tg-mediated radioiodine organification and intracellular retention, may lead to effective radioiodine therapy of thyroid carcinoma

WPU-Net: Boundary Learning by Using Weighted Propagation in Convolution Network

Deep learning has driven a great progress in natural and biological image processing. However, in material science and engineering, there are often some flaws and indistinctions in material microscopic images induced from complex sample preparation, even due to the material itself, hindering the detection of target objects. In this work, we propose WPU-net that redesigns the architecture and weighted loss of U-Net, which forces the network to integrate information from adjacent slices and pays more attention to the topology in boundary detection task. Then, the WPU-net is applied into a typical material example, i.e., the grain boundary detection of polycrystalline material. Experiments demonstrate that the proposed method achieves promising performance and outperforms state-of-the-art methods. Besides, we propose a new method for object tracking between adjacent slices, which can effectively reconstruct 3D structure of the whole material. Finally, we present a material microscopic image dataset with the goal of advancing the state-of-the-art in image processing for material science.Comment: technical repor

E-business Research in China over the Last Two Decades: a Bibliometric Analysis of Projects Granted by National Social Science Fund of China

The fast growth of electronic business activities in China during the last two decades has attracted significant attention from practice as well as academics in different countries. The purpose of this paper is to draw the basic outline of e-business research over the last two decades in China based on e-business research projects granted by National Social Science Fund of China from 1999 to 2017. Changes of the research on e-business over time, subject distribution, geographical distribution, active research institutions and high frequency words have been analyzed. The findings showed that the research subjects on e-business in China over last two decades could be classified into 6 categories: online consumer behavior, trust of e-business, internet business model innovation, rural electronic business, internet financial and macro issues related to e-business. The research on e-business has obtained the attention of researchers from different disciplines including management, economics, law, library, sociology, statistics, sports and journalism. The results have given a clear image of the academic investigation on e-business over the last two decades in China

Persistent Biomechanical Alterations After ACL Reconstruction Are Associated With Early Cartilage Matrix Changes Detected by Quantitative MR.

BackgroundThe effectiveness of anterior cruciate ligament (ACL) reconstruction in preventing early osteoarthritis is debated. Restoring the original biomechanics may potentially prevent degeneration, but apparent pathomechanisms have yet to be described. Newer quantitative magnetic resonance (qMR) imaging techniques, specifically T1ρ and T2, offer novel, noninvasive methods of visualizing and quantifying early cartilage degeneration.PurposeTo determine the tibiofemoral biomechanical alterations before and after ACL reconstruction using magnetic resonance imaging (MRI) and to evaluate the association between biomechanics and cartilage degeneration using T1ρ and T2.Study designCohort study; Level of evidence, 2.MethodsKnee MRIs of 51 individuals (mean age, 29.5 ± 8.4 years) with unilateral ACL injuries were obtained prior to surgery; 19 control subjects (mean age, 30.7 ± 5.3 years) were also scanned. Follow-up MRIs were obtained at 6 months and 1 year. Tibial position (TP), internal tibial rotation (ITR), and T1ρ and T2 were calculated using an in-house Matlab program. Student t tests, repeated measures, and regression models were used to compare differences between injured and uninjured sides, observe longitudinal changes, and evaluate correlations between TP, ITR, and T1ρ and T2.ResultsTP was significantly more anterior on the injured side at all time points (P < .001). ITR was significantly increased on the injured side prior to surgery (P = .033). At 1 year, a more anterior TP was associated with elevated T1ρ (P = .002) and T2 (P = .026) in the posterolateral tibia and with decreased T2 in the central lateral femur (P = .048); ITR was associated with increased T1ρ in the posteromedial femur (P = .009). ITR at 6 months was associated with increased T1ρ at 1 year in the posteromedial tibia (P = .029).ConclusionPersistent biomechanical alterations after ACL reconstruction are related to significant changes in cartilage T1ρ and T2 at 1 year postreconstruction. Longitudinal correlations between ITR and T1ρ suggest that these alterations may be indicative of future cartilage injury, leading to degeneration and osteoarthritis.Clinical relevanceNewer surgical techniques should be developed to eliminate the persistent anterior tibial translation commonly seen after ACL reconstruction. qMR will be a useful tool to evaluate the ability of these newer techniques to prevent cartilage changes

Data-Driven Approach to Human-Engaged Computing

This paper presents an overview of the research landscape of datadriven human-engaged computing in the Human-Computer Interaction Initiative at the Hong Kong University of Science and Technology